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Abstract 



We consider Hamilton Jacobi Bellman equations in an inifinite dimensional Hilbert space, 
Cn . with quadratic (respectively superquadratic) hamiltonian and with continuous (respectively 

lipschitz continuous) final conditions. This allows to study stochastic optimal control prob- 
lems for suitable controlled Ornstein Uhlenbeck process with unbounded control processes. 

-)— » 

J5 ' In this paper we study semilinear Kolmogorov equations in an infinite dimensional Hilbert space 

H, in particular Hamilton Jacobi Bellman equations. More precisely, let us consider the following 

equation 

>: j ^{t,x) = -Cv{t,x) + ij{Vvit,x)^)+l{x), te[0,T],x£H 



1 Introduction 



S: \v{T,x) = ci^{x), ^'-'^ 

oo 

where C is the generator of the transition semigroup Pt related to the following Ornstein- 
r>^ , Uhlenbeck process 

O ■ j dXt = AXtdt + ^dWt, t G [0, T] 

o : i xo = X, ^^-2) 



that is, at least formally. 



(£/)(x) = \{TrQV^f){x) + (Ax, V/(x)). 



The aim of this paper is to to consider the case where tp has quadratic or superquadratic 
growth, and to apply our results to suitable stochastic optimal control problems: to this aim 
we make some regularizing assumptions on the Ornstein Uhlenbeck transition semigroup. At 
first in equation (jl.ip we consider the case of final condition (p lipschitz continuous: with this 
assumption we can solve the Kolmogorov equation with ^ quadratic and superquadratic. In the 
case of quadratic hamiltonian we can solve equation (jl.ip also in the case of final condiotion 
only bounded and continuous. A similar result, with ^p quadratic and superquadratic and with 
final condition (j) lipschitz continuous, is proved in [IH] by means of a detailed study on weakly 
continuous semigroups, and making the assumption that the transition semigroup Pt is strong 
Feller. Here we include the degenerate case and we exploit the connection between PDEs and 
backward stochastic differential equations (BSDEs in the following). 

Coming into more details, we assume that A and Q in equation (|1.2p commute, so that, 
see [17], the transition semigroup Pt satisfies the following regularizing property: for every 



(j) £ Cb (H), for every ^ £ H, the function Ptcp is Gateaux differentiable in the direction -v/QC 
and for < i < T, 

VPt[cP]ix)y^^ <_^||<^||^|^|. (1.3) 

In order to prove existence and uniqueness of a mild solution v of equation (II. ip . we use the 
fact that V can be represented in terms of the solution of a suitable forward-backward system 
(FBSDE in the fohowing): 

' dXr = AXrdT + y^dWr, T S [t, T] C [0, T], 

Xt = X, , . 

dYr = -^{Zr) dT - l{Xr) dr + Z^ dWr, ^ ' 

{ Yt = <P{Xt), 

It is well known, see e.g. [21] for the finite dimensional case and p!2] for the generalization to the 
infinite dimensional case, that v{t, x) = 1^ '^, so that estimates on v can be achieved by studying 
the BSDE 

dY^ = -ip{Zr) dr - l{Xr) dT + Zr dWr, T £ [0, T] , 

YT = cPiXT), ^^■^' 

Moreover, if ip is quadratic, we can remove the lipschitz continuous assumption on (p and 
prove existence and uniqueness of a mild solution of equation (jl.ip with (j) continuous and 
bounded. The fundamental tool is an apriori estimate on Z, and the classical identification 
Zr'^ = Vu(t, Xt-'^)\/Q: the fact that A and Q commute is crucial in proving this estimates on 
'Vv{t,x)y/Q by means of backward stochastic differential equations. This estimate is obtained 
with techniques similar to the ones introduced in [2], and specialized in [22j in the quadratic 
case, to treat BSDEs with generator ^p with superquadratic growth and in a markovian frame- 
work. In [2j the Markov process X solves a finite dimensional stochastic differential equation, 
with constant diffusion coefficient and with drift not necessarily linear as in our case. In order 
to obtain an estimate on Zr^ , some non degeneracy assumptions on the coefficients are made. 
In the present paper the process X is infinite dimensional and we need the coefficient A and ^/Q 
commute. We note that not in [2] nor in [22] the estimate on Z is used in order to solve a PDE 
related. 

We also cite the paper [3] where infinite dimensional Hamilton Jacobi Bellman equations with 
quadratic hamiltonian are solved: the generator £ is related to a more general Markov process 
X then the one considered here in (jl.2p . and no assumptions on the coefficicent are made, but 
only the case of final condition (p Gateaux differentiable is treated. 

We apply these results on equation (11. ip to a stochastic optimal control problem. Let us 
consider the controlled equation 

dX^ = [AX^ + ^Ur] dT + ^dWr, T G [t, T] 

Xf = X. 
where the control u takes values in a closed subset K of H. Define the cost 



J (t, x,u)=E f [I (X^) + giu,)]ds + E^ (X^) 



for real functions I, cp and g on H. The control problem in strong formulation is to minimize 
this functional J over all admissible controls u. We notice that we treat a control problem with 
unbounded controls, and, in the case of superaquadratic hamiltonian, we require weak coercivity 
on the cost J. Indeed, we assume that, for 1 < g < 2, 

< g{u) < c(l + \u\y, and g{u) > C\u\'^ for every u £ K : \u\ > R 



so that the hamiltonian function 

jp (z) = inf {g (u) + zu} , ^z £ H, 

has quadratic growth in z if g = 2, and superquadratic growth of order p > 2, the coniugate 
exponent of q, if q < 2. 

Some example of operators A and Q commuting are hsted in section [21 moreover this conditon 
is satisfied by a stochastic heat equation with coloured noise: 

^{s,0 = ^y{s,0 + ^(^,e), s G [t,T], e G O, 

OS OS {-I j\ 

y{t,0 = x(.0, ^ ^^^ 

y{s,C)=0, (edO. 

Here W'^{s,^) is a Gaussian mean zero random field, such that the operator Q characterizes 
the correlation in the space variable. The bounded linear operator Q is diagonal with respect 
to the basis {efcj^gj^ of eigenfactors of the Laplace operator with Dirichlet boundary conditions. 
Equation ()1.7p can be reformulated in H = L?'{0) as an Ornstein-Uhlenbeck process ()1.2p with 
A and Q commuting. 

The paper is organized as follows: in section [2] some results on the Ornstein-Uhlenbeck 
process are collected, in section [3] the Kolmogorov equation (11. ip is solved with tp with su- 
perquadratic growth and (/> lipschitz continuous, and these results are applied to optimal control, 
in section H] the Kolmogorov equation (jl.ip is solved with quadratic %[) and (f) only continuous and 
again an application to control is briefly presented, finally in section [5] optimal control problems 
for a controlled heat equation are solved. 

2 Preliminary results on the forward equation and its semigroup 

We consider an Ornstein-Uhlenbeck process in a real and separable Hilbert space H, that is a 
Markov process X solution to equation 

dXr = AXrdT + BdWr, T £ [t, T] 

Xt = X, ^^■^' 

where A is the generator of a strongly continuous semigroup in H and B is a linear bounded 
operator from S to H. We define a positive and symmetric operator 



Jo 



'0 

Throughout the paper we assume the following. 

Hypothesis 2.1 1. The linear operator A is the generator of a strongly continuous semi- 
group (e , i > O) in the Hilbert space H. It is well known that there exist M > and 
a; G M such that Ik IL^rr rr-, < Me"*, for all i > 0. In the following, we always consider 
M >1 andoj >0. 

2. B is a hounded linear operator from 3 to H and Q^ is of trace class for every a > 0. 

We notice that in some of the literature, in the case H = ff, in order to define the Ornstein- 
Uhlenbeck process, a bounded, symmetric and positive operator Q is considered, and in equation 
12.11 B is replaced by y/Q. 



The process X is clearly time-homogeneous. It is well known that the Ornstein-Uhlenbeck 
semigroup can be represented as Pr-t = Pt,T-, where 

Pr [(/>] (x) :=/(/> (y) M {e^^x, Qr) [dy] , 
Jh 

and M [e^^x^ Qr) {dy) denotes a Gaussian measure with mean e'^^x, and covariance operator 

Qr- 

In the following we are mainly concerned with the case 3 = H, so we can take B = ^/Q 
and we assume that A and ^/Q commute. This happens e.g. when (e„)^ is an orthonormal 
basis in H and A and Q have the spectral decomposition Asn = —a-nen and Qcn = 7nen where 
o-ni 7n > and a„, f +00. If the a„ are positive apart from a finite number the result is still 
true. 

More in general let H = f/', i? = y/Q. Suppose that A is an unbounded, selfadjoint and negative 
defined operator, A = A* < Q, A : T) [A) C H ^ H, with inverse bounded. We consider the 
spectral representation of A 

A= I sdE{s). 
J —00 

rO 

and Q = {-Af = / {-sf dE (s), for some /3 G R. It turns out that 
J —00 

Qt = f e'^ {-Af e'^ds = - (l - e^^*) {-Af-^ . 
Jo 2 

It is proved in [TT] that in this case the Ornstein-Uhlenbeck semigroup satisfies some regularizing 
property. Namely the following hvpothesis 12.21 holds true with a = 1/2. 

We briefiy introduce the notion of -\/Q-differentiability, see e.g. pij. We recall that for a 
continuous function /://—)• R the -\/Q-directional derivative V^ at a point x G iJ in 
direction ^ £ H is defined as follows: 



V^;(,,;)^l.^/(^- + 'Vgg)-/' 



s G 



A continuous function / is \/Q-Gateaux differentiable at a point x £ H if f admits the \/Q- 
directional derivative V^*^/ (x; ^) in every directions £, € H and there exists a functional, the 
^-gradient V^f (x) € E* such that V^f (x; ^) = V^f (x) ^ 



Hypothesis 2.2 For some a £ [0, 1) and for every (p £ Cb (H), the function P.,- [(f)] (x) is ^/Q- 
differentiable with respect to x, for every < t < t < T. Moreover there exists a constant c > 
such that for every (j) £ Cb (H), for every ^ € H, and for < t < t < T, 



VV^P.M(x)e <^||</'|loolCl- (2-2) 



In jT^ hypothesis 12.21 is verified by relating -v/Q-differentiability to properties of the operators 
A and ^/Q. Namely if 

Ime*^ygcImQy^ (2.3) 

and for some < q < 1 and c > the operator norm satisfies 



,-1/2 M 



< ct"", for < t < r. 



then hypotheses 12.21 is satisfied. 

We also notice that this can be proved with a procedure similar to the one use in p] to prove 
the Bisniut-Elworthy formula. Namely, see e.g [8j, lemma 7.7.2, for every uniformly continuous 
function with bounded and uniformly continuous derivatives up to the second order, 



t,x\ 



Hx. 



By multiplying both sides of (j2.4|) by 



Pt,rHx) + / < VPs,rHX'f), VQdWs > 



<V{Xl^'^)h,dWs > 



a.s. 



and by taking expectation one gets 



E 
E 



j^ < y^vPs,r4>{xin,^{xinhds > 

< V^EPs,r<P{Xl^''),h yds 

<V^Pt,sPs,r(t>{^),h>ds 
(T-t) <V'^Pt,r(t>{x),h> 



(2.4) 



(2.5) 



By arguments similar to the ones used in [8], lemma 7.7.5, we get that for every bounded and 
continuous function 0, the function P^ [(j)] (x) is \/Q-differentiable with respect to x, for every 
< t < T < T and 



V^Pt,,[0](x)^ 



< 



lei- 



(r - t)i/2 

An analogous result can be proved in the case of A and Q commuting and P transition semigroup 
of the perturbed Ornstein Uhlenbeck process 

dXr = AXrdT + ^/QF{t, Xr) + y/QdWr, T G [i, T] 

Xt = X, 

with F jointly continuous in t and x and lipschitz continuous in x uniformly with respect to t. 
The model we have in mind consists of an heat equation. Namely let O be a bounded domain 
in M. We denote by H the Hilbert space LP'{VL) and by {ek}^.^^ the complete orthonormal basis 
which diagonalizes A, endowed with Dirirchlet boundary conditions in O. We consider the 
equation 

^{s,0 = ^y{s,0 + ^(^,0, ^ e [t,T], e G o, 

(2.6) 



ds 



ds 



Here W^{s,^) is a Gaussian mean zero random field, such that the operator Q characterizes the 
correlation in the space variables. Namely the covariance of the noise is given by 

E < W^{s, •), h >H< W^{t, ■),k >H= tAs<Qh,k>H ■ 

In particular W'^{s, S,) can be the Brownian sheet so that g^gg {s, S,) in this case is the space-time 
white noise. More in general we think about a coloured noise and on Q we make the following 
assumptions: 



Hypothesis 2.3 The bounded linear operator Q : H ^ H is positive and diagonal with respect 
to the basis {ek}keN' '"'^^^ eigenvalues {^k}keN- 

By previous assumptions it turns out that Xk > 0. Note that W^{s, •) is formally defined by 

n 

W'^is,-) = Y.Qek{-)Pk{s) 
k=l 

where {/5fc(s)}^gj^ is a sequence of mutually independent standard Brownian motions, all defined 
on the same stochastic basis (fi, J-", J-i,P). 

Equation (|2.6p can be written in an abstract way in H as 

dXr = AXrdT + ^dWr, T G [t, T] 

Xt = x, ^^-^^ 

where A is the Laplace operator with Dirirchlet boundary conditions, VK is a cylindrical Wiener 
process in H and Q is its covariance operator. 

3 The semilinear Kolmogorov equation: lipschitz continuous fi- 
nal condition 

The aim of this section is to present exitence and uniqueness results for the solution of a semi- 
linear Kolmogorov equation with the nonlinear term which is quadratic with respect to the 
"v/Q-derivative. The following arguments presented in this section work also in the case of tp 
with superquadratic growth with respect to z. 

More precisely, let C be the generator of the transition semigroup Pt, that is, at least formally, 

(£/)(x) = liTrQ*Vy-){x) + (^x, V/(x)). 

Let us consider the following equation 

I wit, x) = -Cv {t, x) + ^ (V^^; {t, x)) + l{x), t G [0, T] , X G /7 ^^ ^^ 

[ v(T,x) = (pix) , 

We introduce the notion of mild solution of the non linear Kolmogorov equation ()3.ip . see e.g. 
|12j and also [17j for the definition of mild solution when tp depends only on V^^v and not on 
Wv. Since C is (formally) the generator of Pt, the variation of constants formula for (|3.ip is: 

/■T f-T 

v{t,x) = Pt,T[4>]{x)- Pt,s i^iV'^vis,-)) {x)ds,- Pt,s[l]{x)ds, te[0,T],xeH. 



(3.2) 
We use this formula to give the notion of mild solution for the non linear Kolmogorov equation 
(j3.ip : we have also to introduce some spaces of continuous functions, where we seek the solution 
of (f3T]) . 

For a > 0, let Ca{[0,T] x H) (denoted by C([0,T] x H) for a = 0) be the linear space of 
continuous functions f : [0,T) x H ^R such that 

sup sup (T — t)" 1/ (t, x)| < +00. 

t£[0,T]x£H 



Ca ([0, T] X H) endowed with the norm 

11/11^^= sup sup {T-tr\f{t,x)\, 
telo,T]x&H 

is a Banach space. 

We consider also the hnear space C^ ([0, T] x H,H*) (denoted by C ([0,T] x H,H*) for a = 0) 
of the mappings L : [0,T) x H ^ H* such that for every C (^ H, L{-,-) ^ e C^ ([0, T] x H). The 
space C^ ([0, T] x H, H*) turns out to be a Banach space if it is endowed with the norm 

\\L\\cUH*)= sup sup(r-t)"||L(t,x)||j:^. . 

In other words, C^ ([0, T] x //, /f*) can be identified with the space of the operators 
L{H,C^{[Q,T]xH)). 

Definition 3.1 Let a £ [0, 1). We say that a function v : [0,T] x H ^ M is a mild solution of 
the non linear Kolmogorov equation \3. 1\) if the following are satisfied: 

1. v£C,{[^,T]xH); 

2. V^v G C^ ([0, T] X H,H*): in particular this means that for every t G [0,T), v{t,-) is 
y/Q-differentiahle; 



3. equality V3.'^) holds. 

Existence and uniqueness of a mild solution of equation ()3.ip is related to the study of the 
following forward-backward system: for given t G [0, T] and x G if , 



' dXr = AXrdT + ^/QdWr, T G [t, T] C [0, T] , 

dY^ = -7p{Zr) dT - l{Xr) dT + Z^ dWr, ^ ' ' 

{ Yt = ^{Xt), 

and to the identification of Z^'^ = VxY^ '^y/Q. We extend the definition of X setting Xg = x for 
< s < t. The second equation in ()3.3p . namely 

dYr = -TpiZr) dT - l{Xr) dr + Zr dWr, T G [0, T] , 

Yt = cP{Xt), ^"^ ' 

is of backward type. Under suitable assumptions on the coefficients ip : H ^- W, I : H ^ M. and 
(/) : if — )• R we will look for a solution consisting of a pair of predictable processes, taking values 
in M X H, such that Y has continuous paths and 

rT 

II (y, Z) |||_^ := E sup \Yr\''+E \Z^f dr < ^, 
tg[o,t] Jo 

see e.g. [20]. In the following we denote by Kcont ([0, T]) the space of such processes. 

The solution of (jS.Sp will be denoted by {Xr,YT-, Zr)r£[o,T]j ov^ to stress the dependence on 
the initial time t and on the initial datum x, by {X^^ ,Yt-'^ , ZT-'^)^gro yi. In the following we refer 
to [12] for the definition of the class Q{H) of Gateaux differentiable functions f : H ^ M with 
strongly continuous derivative. 



Hypothesis 3.1 The maps tp : H ^ M, I : H ^ M and (p : H ^ M are Borel measurable, 
moreover -0 is Gateaux differentiable, nam,ely ip £ Q{H) () and for every .^1,^2 G S; |'0(Ci) ~ 
^^(6)1 < (1 + 161^"^ + I6l^"^)l?i - 61, forp > 2. The maps I and cj) belong to Cb{H). 
Moreover from now on we assume that, unless modifying the value of I, "0(0) = 0. 



We make differentiability assumptions on the coefficients of equation (j3.4p : 

Hypothesis 3.2 I and (p belong to Q{H) and have bounded derivative. 

Assume that in hypothesis I3.1l p = 2. So by [15], under hypothesis 13. II the BSDE (|3.4|) admit 
a unique solution and by [3J, under the further assumption 13.21 setting v{t,x) := Y^ '^, it turns 
out that V is the unique mild solution of equation (|3.ip . and V^v{t,x) = Z^'^ . By assuming 
that A and Q commute, or, more in general, by assuming that hypothesis 12.21 holds true, also 
imposing a more restriye structure on the forward equation and on the backward equation, we 
will prove in section U] an estimate on Zr^ depending on r, t, T and ||0||oo but not on Vcj). 
Thanks to this estimate we will prove that by setting 

^;(t,x):=y/•^ (3.5) 

it turns out that v is the unique mild solution of equation (13. ip . and V^v{t,x) = Z^^ without 
assumption 13.21 We note that differentiability on /, thanks to the regularizing property of the 
semigroup, can be easily removed. So from now on we can consider the case of / = 0. 
We go on in this section with the study of equation ()3.ip with -il) superquadratic. 



3.1 Local mild solution of the corresponding PDE 

In this subsection we look for a local mild solution of equation (13. ip . that is a mild solution in 
a small time interval. We work on the PDE following [M], but the same result can be achieved 
by working on the BSDE with a procedure similar to the one indicate in [2], section 4.1. 

We start by proving existence of a local mild solution to equation (j3.ip . and then we look 
for a priori estimates for this local mild solution. 

Theorem 3.3 Assume that hypotheses \2. R fSTH \3. 1\ [37B hold true. Then equation 113. 1\) admits 
a unique local mild solution u on [T — 6, T] , for some < 6 < T according to definition \3.1[ 



Proof. The first part of the proof is similar to the proof of theorem 2.9 in [17J and we partially 
omit it. Consider the product space A : C {[0,T] x H) x C {[0,T] x H,H*) with the product 
norm. Let us also denote by Arq the closed ball of radius Rq, with respect to the product norm 

\\{fiL)\\c{[0,T]xH)xC''([0,T]xH,H*) = ll/llc([0,T]xH) + l|-^llc"'([0,r]x_H',J/*)- 

Let us also define, for (u, v) £ A/Jq 

El [v, w] {t, x) = Pt,T [0] {x) - I Pt,s [i^ {w {s, ■))] {x) ds- [ Pt,s [I] (x) ds, (3.6) 

Jt Jt 

E2 [v, w] {t, x) = V-^Pt^T [4>] (x) - / V^Pi,, [^ {w {s, •))] (x) ds. - / V^Pi,, [I] (x) ds (3.7) 

Jt Jt 

Thanks to condition (j2.2p and if 6 is sufficiently small, P is well defined on A/j^ with values in 
itself. Indeed, let us take 

Eo = 2Me'^^(||0||i+r|m|i) 



It turns out that 

||ri [v,w] ,T2 [v,w] \\c{[0,T]xH)xC={[0,T]xH,E*) 

< (||</.||i + r||/||i + (T - t)CR,Ro + (T - ty~^CCR,)Ro 

< (i + (T - t)CR, + {T- t)'~^CCR,)Ro, 



where Cr^ is the hpschitz constant of ip if \v\c'^{[o,t]xH,h*) ^ -^o- For t £ [T — 6,T] and 6 
sufficiently small we get that ^ + 6Crq + (5^~"CCijo < 1, so that T : Ar^ — )• Ajjq Moreover, 
arguing as in [17J, theorem 2.9, it is possible to show that F is a contraction in Ar^, and so we 
are able to find a unique local mild solution to equation (13. ip . D 

3.2 Equivalent representation of the mild solution 

In this subsection we give an an alternative representation of the mild solution of equation (j3.ip . 
Let V be the local mild solution of equation (|3.ip . as stated in theorem 13.31 Let us define 

G{t,x)= f V^{\V^v{t,x))dX. (3.8) 

Jo 



We present in an informal way the object of this subsection. Equation (j3.ip can be rewritten as 

u{T,x) = (j) (x) 



If (t, x) = -Cv (t, x) + {VQG{t, x),Vv{t, x)) + l{x), t£[0,T], xeH ,^^. 



Let us consider the Markov process 0.'^ solution to equation 

dQ'f = AQ'fdT + ./QG{t, QY)dT + ./QdWr, t £ [t,T] t £ [T - 6, T] .„ ^ „, 

et = x, ^^-^"^ 

Let us denote by Rt^r the transition semigroup of 0. '^ Following [H] , since the operator Cu (t, x)+ 
{\/QG{t, x),'Vu{t, x)) is formally the generator of R, we want to prove that the mild solution of 
()3.ip for t £ [T — 6,t] can be represented as 

v{t, x) = Rt,T [ct>] {x) - j Rt,s [l\ {x) ds, tG[T-5,T], x£ H. (3.11) 

Representation (j3.1ip immediately gives an a priori estimate for the norm of v in C([0,T], H). 
In the following lemma we notice that equation (j3.10p admits a unique mild solution in weak 
sense. First of all we state an existence and uniqueness result for equation (j3.10p . 

Lemma 3.4 Let hypothesis \ 2. 1\ and \3.1\ on tp hold true, let G he defined by \3.^) . then equation 
\3.1 0|) has a unique mild solution in weak sense, and this solution is unique in law. 

Proof. By the Girsanov theorem, since |G(t,x)| < Rq, there exists a probability measure P, 
equivalent to the original one P, such that 



lWr= I G{r,x)dr + Wr,T>Q 



is a Brownian motion. In the probability space (il, T ^ P), 0*'^ is an Ornstein-Uhlenbeck process: 

dQ^f = Ae^^'^dT + ^/QdWr, T G [t, T] 

and this guarantees existence and uniqueness in law of a weak solution to equation 13.101 This 
suffices to have the transition semigroup R well defined. D 

Next we want to prove that representation ()3.1ip holds true. A similar result is obtained in 
[M] by using the results in [5] , [6] about Cauchy problems associated to weakly continuous semi- 
groups, such as transition semigroup. Here we use the connection between PDEs and BSDEs. 
We notice that in |2j a BSDE in a Markovian framework with generator with superqadratic 
growth is solved also in the case of final datum continuous in x. With the following techniques 
we solve a semilinear Komogorov equation like (jS.ip . in the case of lipschitz continuous final 
datum. Notice that by asking some smoothing properties of the transition semigroups allows 
also in this case to identify in the corresponding BSDE Z^'^ with V^*^!^'^. In this way our 
results can be applied to solve a related stochastic optimal control problem. 

Proposition 3.5 Assume that hypotheses \2.1[ \2.SX \3.1{ \3.S\ hold true. Then the local mild 
solution V of i3.1\) can be represented as in \3.11]) . 

Proof. Let u be the local mild solution of (j3.ip and let us define 

y^*'^ = t;(r,X*'^), Z*'^ = V^w(t,X*'^), (3.12) 

where as usual for < r < t, Xr^ = x. It is well known that the pair of processes (l^r'^, ■^r'^)o<T<T 
is solution of the BSDE (13. 4p . Moreover since v is a local mild solution of (13. ip . \Zt^\ < Rq 



i'-a.s.. Since by our assumption 13.11 t/^ is locally lipschitz continuous it turns out that 



fir) :-- 



otherwise 



is bounded. So, by using the techniques introduced in [3] , by the Girsanov theorem there exists 
a probability measure P, equivalent to the original one P, such that 



|w^^ = - I /(r)dr + VF^,r > ol 



is a Brownian motion. So in (fi, J^, P) equation (j3.4p can be rewritten as 

dYr = -l{Xr) dr + Zr dW^, T G [0, T], , . 

Yt = HXt). ^ ^ ^ 

We notice that in {Q,J^,¥) X is solution to 

dXr = AXrdr + VQG{t, Xr)dT + ^dWr, T G [t, T] 

Xt = x, 

and lemma 13.41 guarantees existence, uniqueness and regularity of the mild solution of this 
equation. Moreover with respect to the new probability measure P the transition semigroup 
of X coincides with Rt^T- In particular we notice that the law of {X,Y,Z) depends on the 
coefficients A, G, ip, I, (p, on the initial condition x given at initial time t, but not on the 
probability space nor on the Wiener process. So in particular it turns out that again, since Y^ 



t,x 



is deterministic, it coincides with u(t,x), mild solution of equation 13.91 So it turns out that mild 
representation 13.111 holds true. D 
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Remark 3.6 It is possible to prove that for the local mild solution u of equation \3. i|) there 
exists L > such that for every x,y £ H and for every t G [T — 6,T] 

[T - t)°|V^w(t, x) - V^v{t, y)\ < L\x - y\ (3.15) 

This can he proved by showing that T defined in the proof of theorem |g.3l is a contraction in the 
product space C([0,r] x H) x Cf_„ ([0,T] x H,H*) where by Cf „ ([0,r] x H,H*) we mean the 
space of the operators L £ C^ ([0,T] x H,H*) such that (T — t)'^L{t,x) is lipschitz continuous 
in X uniformly with respect to t. We endow Cf ^ ([0,^] x H,H*) with the norm 

\m\ci^(H*)= sup sup ||L(t,x)||^. + sup sup {T -tf\\L{t,x) - L{t,y)\\jj, . 
te[o,T]xeH te[o,T]x,yeH 

and we endow C([0,T] x H) x Cf „ ([0)2^] ^ H,H*) with the product norm. Let us also denote 
by A/j(, the closed ball of radius Rq, with respect to the product norm 

ll(/i-^)llc{[0,T]x_H")xCi,„{[0,T]x_H",ii'*) = ll/llcClO.TlxH) + \\L\\ci,c.{lO,T]xH,H*)- 

Let us also define Fi and T2 as in i3.6\) and (3.1). We take Rq and 6 as in the proof of theorem 



\3.3[ We have to prove that T : A^p — >• Ajjp and it is a contraction. For the firts point, in view 
of the results of theorem \3. 3\ we have to prove that (T — t)"r2 [v, w] {t, •) is lipschitz continuous. 
For S, €z H we have 

\{T -tr{T2[v,w]{t,x) -T2[v,w]{t,y))\ 

i(r - trv^Pt,Tmx)^ - v^Pt,Tmy)(\ + {t- tr j \v^Pt,sm^)i - v^Pt,smynds 
+ {T- tr J \v^Pt,smwis, •))](x)e - v^PtAMs, ■my)^\ds = i+ii+ m. 

We start by estimating I, following e.g. ^ and flTi^ we get : 

I = {T- t)"| V^ / (0(z + e(^-*)^x) - ^{z + e(^-*)^y))AA(0, QT~t)dz\ 
Jh 

= {T- tr\ [ {<p{z + e(^-*)^x) - 4>{z + e(^-*)^y))(g^y/e(^-*)^yge, Q^i//^)AA(0, QT-t){dz) 
Jh 

Arguing in a similar way it follows that 

II < (r-i)Me'^(^-*)||(/.||i 

so that 

I + II< Rq/2 
For what concerns III we get 

III ={T-tT I I \ij{w{s, z + e(^-*)^x)) - i}{w{s, z + e^^"*)^?/))] 
Jt Jh 

{Q;li'e'^'-'^^VQtQ;-i'z)Af{0,Qs^t){dz)ds 

< {T-trRQCR,Me^^'^''\x-y\H j {T - s)-^\\Q-l{\^'-'^^^\mds 
<2RoCB^{T-tf-^, 
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where we have used the fact that u is the local mild solution and ij) is locally lipschitz continuous. 
Also by the proof of theorem \3.3\ it turns out that 

llTi [v,w] ,T2 [v,w] ||c{[0,T]xH)xC».i."{[0,T]xH,H*) 

< (1 + (T - t)CR, + 3(r - ty~''CCR,)Ro, 



LetO < 6 < 6 be such that for t e [T - 6,T] we get that 1 + 6Cro + 36^-"CCro < 1, so that 
r : Arq —?- Arq . 

Moreover, it is possible to show that T is a contraction in Ar^, and so we are able to find a 
unique local mild solution to equation iH.l]) in C([0, T] x H) x C*'^'" ([0,r] x H,H*). 

n 

As a consequence equation (j3.10p admits a unique mild solution, in classical (strong) sense. 

Lemma 3.7 Let hypothesis \ 2. 1\ and \3.1\ on -0 hold true, let G be defined by ^3. ^) . then equation 
\3.10\} has a unique mild solution satisfying moreover, for every x,y £ H, 

\Q'f-e!;y\<CT\x-y\ 

Proof. The proof is standard apart from the singularity of the Lipschitz constant of G in T = i: 
by theorem 13.31 the local mild solution u is Lipschitz continuous according to estimate 13. 151 ^-iid 
so also G is. Lideed, for every x,y S H, 

(T - tr\Git,x) - Git,y)\ < L\x - y\ 

Existence, uniqueness and Lipschitz property of a mild solution of equation 13.101 follow as in 
[14] . proposition 3.9. D 

The aim of the next section is to find a priori estimates for the local mild solution of equation 
I3.1l bv using reperesentation ()3.1ip . We notice that, the transition semigroup Rt^T is a perturbed 
Ornstein-Uhlenbeck transition semigroup, so we could try to investigate if it satisfies regularizing 
properties like the ones satisfied by the Ornstein-Uhlenbeck transition semigroup contained in 
12. 2i Anyway there are some difficulties related to the coefficient G in equation (j3.10p : G is 
not differentiable and blows up like (T — t)~", so it is in general not square integrable since 
< a < 1. In particular when A and Q commute, hypothesis [2]2] holds true with a = 1/2. In the 
existing literature, see e.g. [10], |18] and references therein, regularizing properties for perturbed 
Ornstein-Uhlenbeck transition semigroup, such as the strong Feller property or propertv l2.2| are 
proved by means of "generalizations" of the Girsanov theorem and then by means of the Malliavin 
calculus, eventually with direct calculation of the Malliavin derivative. Here this cannot be done: 
since G is not square integrable, no immediate generalization of the Girsanov theorem can be 
applied. Also, G is not differentiable, so the existing theory cannot be directly used, even if in 
this direction generalizations seem less involved. 

3.3 A priori estimates and global existence 

In this section we investigate a priori estimates for the local mild solution of equation 13.11 that 
we have found in theorem 13.31 By proposition 13.51 the equivalent representation ()3.1ip for the 
mild solution v holds true and this immediately gives an a priori estimate for the supremum 
norm of v, namely 

IHIc<(ll'Allo + r||/||o)<^. (3.16) 
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G 



V. 



Next, we look for a priori estimates for the norm || -11(7(^7*) of V 
In order to prove an a priori estimate for the norm |H|(7(/^.) of V u , we expfoit again the strict 
connection between PDEs and BSDEs. We start by the fact the if v is the local mild solution of 
()3.ip . and X. '^ is the Ornstein-Uhlenbeck process defined by ()2.ip . then ((f (r, Xr^))r, (Vv{t, Xr^))r) 
is solution to the the BSDE (13.41). that we rewrite for the reader convenience: 



dY^^^ = -^PiZ'f) dr - l{X'f) dr + Z'f dWr, r e [0,r], 

For ^ G F let us define, if it exists, F^'^ = V^Yr'^'C, Vr'"' = V^Z^'C- I* turns out that such 
processes exist, {Fr'^,Vr'^) G Kcont ([0, T]), and that they are solution to 

/ dF','^ = -^(Z*'")^*'" dr - V/(X*'")e(^-*)^7Qe dr + K*'^ dWr, r G [0, T], 

which is equation 13.171 differentiated in direction y/Q^, since for t < t < T, V^^Xr^^ = 

Proposition 3.8 Assume that hypotheses \2.1\\2^\3.1\ and \3.3\ hold true. Then equation 113. 18]) 
admits a unique solution that is a pair of predictable processes, taking values in M x H , such 
that F has continuous paths and F^ '^ is bounded. 

Proof. We notice that again Zr^ = V^^u{t, Xr^) where u is the local mild solution of equation 
I3.1[ Since Vip is locally lipschitz continuous, it turns out that 



/i(t) : = 



t,x\ 

ZY if ZT ^ 



VV'(2'*''') t,x ,r ryt,X 



I 7*:^'|2 

otherwise , 



is bounded. Following again the method in [4] by the Girsanov theorem there exists a probability 
measure P, equivalent to the original one P, such that 



[Wr = - r h{r)dr + Wr, T>o| 



is a Brownian motion. So in ($7, J^, P) equation (|3.18p can be rewritten as 

/ dFl'- = -V/(X*--)e(--*)^yQ^ dT + Zi'- dWr, T G [0,r], 

In this equation the generator —\Il{Xr^)e^'^~*' y/QS, is independent on F and V and it is 
bounded, so by classical theorems on BSDEs equation ()3.19p admits a unique solution (F, V) 
such that F has continuous paths and 

\\{F,V)\\l :=E sup IF^'^I^ + e/ I V;*'^ I ^ dr < C7, 

see e.g. [20]. Notice that the constant C depends only on A, G, I, ip on the initial condition x 
given at initial time t. In particular 

I^M'i <Me^^(||</)||i+r||/||i) 

D 
We immediately deduce the following result: 
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Corollary 3.9 Assume that hypotheses {KH \2.^ , \3.1\ \3.S\ hold true and let u he the local mild 
solution of equation hS.l]) . as stated in theorem, 13.51 



l^llc([0,T]x_H") 



+ 



yVQy 



< Rq. (3.20) 

C{[0,T]xH,H*) 



Proof. The estimate for the norm \\-\\(j of u follows by (|3.16|) . the estimate for the norm IHIcfH*) 

of V^'^u follows by proposition 13.81 D 

We can state a result on existence and uniqueness of a mild solution u of equation (j3.ip . 
which immediately gives a unique mild solution of equation (j3.4p . 



Theorem 3.10 Assume that hypotheses {2Ji f^^ EH and\EE hold true. Then equation liS. 1]) 
admits a unique mild solution u according to definition \S . 1\. Let X. '^ he solution of equation Ii2.1\) . 
The pair of processes (l^r'^ = v{T,Xr^), Zr^ = V^v{t, Xr'^))^^^Q^rpj is the unique solution of 
the BSDE (fOj. 



Proof. The global existence of the mild solution v follows by the local existence (Theorem 13. 3p 
and by the a priori estimates (Corollary 13. 9p . The connections between PDEs and BSDEs is 
classical in the literature also in the infinite dimensional case (see e.g. [12]) and the proof is 
complete. D 

The next step is to remove differentiability assumptions on I and (p. We start by assuming / 
bounded and continuous and bounded and lipschitz continuous. 

Theorem 3.11 Assume that hypotheses \2.1\ \2.S\ \3.1\ hold true and that I is hounded and 
continous and (j) is hounded and lipschitz continuous. Then equation |3.^D admits a unique 



solution, that is a pair of processes (Y. '^,Z.'^) G M.conti[0,T]). The function v{t,x) = Y^'^ is 
the unique mild solution of equation Ii3.1\) according to definition \3.1[ 

Proof. We consider the inf-sup convolution of (j) (see e.g. [16j and [8j) denoted by (/>„ and defined 
by 



(/)n (x) = sup < inf 



I |2 

4>{y) + n^-^p^ 



n\x-z\]j). (3.21) 



Similarly, let us define In the inf-sup convolution of /. It is well known that (pn £ UC^^' (H) and 
as n tends to +oo, (j)n converges to (j) uniformly. Moreover, see also |T7], let us denote by L the 
Lipschitz constant of (p; then |V(/>| < L. 

Now let us denote by {Y.^' '^ , Z!^' '^) the unique solution of the BSDE (j3.4p with (pn and /„ in 
the place of (j) and I respectively. By standard results on BSDEs we know that as n — )• cxd 

E sup |y;^.*'^-y^*'^|2 + E / |z;^'*'^- z*'^|^dT^ o 
tg[o,t] Jo 

and moreover 

||(y",z")||| <c 

where C is a constant independent on n. We need to prove some further regularity on Z let us 
denote by {F""' '^ , V.'^' '^) the unique solution of the BSDE (|3.18p with </)„ and /„ in the place of 
(j) and I respectively. It turns out that 

E sup If;''*'^!^ < C 
Te[o,r] 
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where C is a constant depending on L and on ||i?!>||oo) and independent on n. So the process 
Z"' '^ is uniformly bounded in n, since for ^ £ H, Z"' '^^ = F^' '^ ■ We also get that 

E sup |y^*'^f + E sup |Z*'^f <C. 

t£[0,T] re[0,T] 

By setting v{t, x) = Y^ '^, \/^v{t, x) = Z^'^ , we have found a (unique ) mild solution to (|3.ip . D 



3.4 Application to control 

We formulate the stochastic optimal control problem in the strong sense. Let ($7,7-", P) be 
a given complete probability space with a filtration (Jv)^>q satisfying the usual conditions. 
{W^ (r) ,r > 0} is a cylindrical Wiener process on H with respect to (Jv)^>g. The control u is 
an (J>)^-predictable process with values in a closed set i^ of a normed space U; in the following 
we will make further assumptions on the control processes. Let R : U ^^ H and consider the 
controlled state equation 

dX« = [AXJ^ + VQR (ur))] dr + VQdWr, r G [t, T] 

Xf = X. \ ■ ) 

The solution of this equation will be denoted by Xr' '^ or simply by X". X is also called the 
state, u and T > 0, t G [0, T] are fixed. The special structure of equation (|3.22p allows to 
study the optimal control problem related by means of BSDEs and (I3.22P leads to a semilinear 
Hamilton Jacobi Bellman equation which is a special case of the Kolmogorov equation (|3.ip 
we have studied in the previous sections. The occurrence of the operator y/Q in the control 
term is imposed by our techniques, on the contrary the presence of the operator R allows more 
generality. 

Beside equation (|3.22p . define the cost 

J{t,x,u)=EJ' [l{X^) + g{u,)]ds + E(l){X^). (3.23) 

for real functions /, (j) on H and g on U. The control problem in strong formulation is to minimize 
this functional J over all admissible controls u. We make the following assumptions on the cost 
J. 

Hypothesis 3.12 1. The function ://—)■ M is lipschitz continuous and bounded; 

2. I : H ^ M is bounded and continuous; 

3. g : U ^M is mesurable; and for some 1 < q <2 there exists a constant c > such that 

< g{u) < c(l + Inl*) (3.24) 

and there exist R > 0, C > such that 

g{u) > C\u\'^ for every u £ K : \u\ > R. (3.25) 

In the following we denote by Ad the set of admissible controls, that is the -fC- valued predictable 
processes such that 

E / \ut\'^dt < +00. 
Jo 
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This summability requirement is justified by (|3.25p : a control process which is not g-summable 

would have infinite cost. 

We denote by J* {t, x) = iniueAd ^ (*> ^' "") ^^^ value function of the problem and, if it exists, by 

u* the control realizing the infimum, which is called optimal control. 

We make the following assumptions on R. 

Hypothesis 3.13 R : U ^ H is measurable and \R{u)\ < C(l + |n|) for every u G U. 

We have to show that equation (|3.22p admits a unique mild solution, for every admissible 
control u. 

Proposition 3.14 Let u he an admissible control and assume that hypothesis \2.1\ holds true. 
Then equation \3. 22\) amits a unique mild solution (XT-)re[t,T] such that Esup^gu^i \Xt-\'' < oo. 

Proof. The proof follows the proof of proposition 2.3 in |11] . with suitable changes since in 
that paper the finite dimensional case in considered and the current cost g has quadratic growth 
with respect to u, that is in (I3.25P q = 2. 

In order to make an approximation procedure in (j3.22p we introduce the sequence of stopping 
times 

Tn = inf 1 1 G [0, T]:E \us\''ds > n 

with the ususal convention that r^ = T if this set is empty. Following the approximation 
procedure used in the proof of proposition 2.3 in [H] we can prove that there exists a unique 
mild solution with the required g'-integrability. D 

We define in a classical way the Hamiltonian function relative to the above problem: 

V- {z) = inf {g (u) + zR{u)] Vz G H. (3.26) 

We prove that the hamiltonian function just defined satisfies the polynomial growth conditions 
and the local lipschitzianity required in hypothesis 13.11 

Lemma 3.15 The hamiltonian ip : H ^ M is Borel measurable, there exists a constant C > 
such that 

-C{1 + \z\P) < tp{z) < g{u) + \z\{l + |n|), Vn G K, 

where p is the coniugate exponent of q. Moreover if the infimum in \S.2b]) is attained, it is 
attained in a ball of radius C(l + |^;|^~"^) that is 

ihiz) = inf {g (u) + zR(u)} , z e H, 

u&K,\u\<C{l+\z\P--L) 

and 

i){z) <g{u) + zR{u) if \u\ > C{1 + \z\p-^). 

In particular it follows that ip is locally lipschitz continuous, namely \/ zi, Z2 G H, for some 
C>0, 

mzi) - v(^2)i < c(i + \z,r' + \z2r')\zi - Z2\ (3.27) 

Proof. The measurability of ip is straightforward. By assumption (j3.25p we get 

g{u) + zR{u) > C{\u\'^ - \R\'^) - Ci\z\{l + \u\) (3.28) 
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where C and R are as in ()3.25p and Ci > 0, and by this it fohows that 

ij(z) > inf {g(u) + zR(u)} > C(\u\'^ - IR^ - Ci\z\(l + \u\) > -C2\z\p - C3 

uGU 

for suitable constants C2 and C3. Moreover 

mz)\ <giu) + c\z\{l + \u\). 
Now we prove that the infimum is attained in the bah of radius C(l + |z|p~^). By (|3.28p . 

giu) + zR{u) > C\u\{\u\'^-'^ - ^\z\) - C\R\'^ - Ci\z\. 

On the other hand, for some u^ £ K : 

g{u^) + zR{u^) <C4(l + |z|). 
and so there exists a constant C such that if \u\ > (7(1 + Izj*'^"'^) then 

g{u) + zR{u) > g{u°) + zR{u°) 
and the resuh fohows from the continuity of g and R. Finahy (j3.27p now easily follows. D 

Remark 3.16 We give an example of hamiltonian we can treat. Let g{u) = 1^1"^, l<g<2. 
Then, if R{u) = u, the hamiltonian function turns out to he 

ij{z) = 

where p > 2 is the coniugate of q. With this example, for p = 2, the Hamilton Jacobi Bellman 
related can be solved with the ad hoc exponential transform, see e.g. \14^ . Our theory cover also 
the case of hamiltonian functions not exactly equal to \z\^ . 

We define 

r(s, x,z)={ueU : zR{u) + g{u) = ^{z)] ; (3.29) 

if r(z) 7^ for every z G -ff, by |lj, see Theorems 8.2.10 and 8.2.11, V admits a measurable 
selection, i.e. there exists a measurable function ^ : H ^ U with 7(2;) G r(z) for every z G M. 

In the following theorem, in order to prove the so called fundamental relation, we have to 
make further assumptions concerning differentiability of the hamiltonian function ip. These 
assumptions allow us to say that the Hamilton Jacobi Bellman equation relative to the above 
problem, which is given by equation (j3.ip . admits a unique mild solution by theorem 13.31 More- 
over this solution can be represented by means of the solution of the BSDE p.4p . namely the 
solution is given by v{t,x) = Y^ '^ . So, adequating to our context the techniques e.g. in [TT], we 
can prove the fundamental relation for the optimal control. 

Theorem 3.17 Assume hypotheses \2.1[ \2.^ \3.1^ and \3.13\ hold true, and assume that the 
hamiltonian function ip satisfies Gateaux differentiability assumptions stated in hypothesis 13. Jl 
For every t £ [0, T], x £ H and for all admissible control u we have J{t,x,u{-)) > v{t,x), and 
the equality holds if and only if 




Gr('v^y(s,X,"'*'^)) 
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Proof. For every admissible control (iit)te[o,T]) we define, for every n G N, 

^r = Utl\ut\<n + nl\ut\>n- 

Since u G L''{Q x [0,T]), then u" — > u in L'?($7 x [0,T]) and so n" — ^ n with respect to the 
measure dt x P. Since moreover the sequence {un)n is monotone, then the convergence holds for 
almost all t £ [0, T] and P- almost surely. Moreover it follows that 

/ \R{u1)\'^ds<C f {l + \u'l\fds<C{l + n^). 
Jo Jo 

Let us define 

Pn = exp(-j R{yJl)dWs-\j \R{u'l)\''ds\ 

In the probability space (fi, F, P) let X" denote the solution of equation 



dXf = [AXf + ^R {u"^))] dT + ,/QdWr, T G [t, T] 
Xf = X. 



(3.30) 



By the Girsanov theorem there exists a probability measure P", equivalent to the original one P, 
namely — — = p„, and such that W" := Wt + /q R{u^)ds is a P"-Wiener process. In (il, F, P"), 
X" solves the following stochastic differential equation 



dXf = AXf + ^/QdW^, T G [t, T] 
Xf = X. 

Let us also denote by (y",Z") the solution in (f], J",P") of the BSDE 

dY^ = -ipiZ^) dT - l{Xf) dT + Z"^ dWf T G [0, T] 
Yt = cb{Xf). 



(3.31) 



(3.32) 



We notice that the law of {X^ ,y",Z") depends on the coefficients A, \fQ^ tp, I and (p and 
not on the Wiener process nor on the probability space. So in particular l^"'' '^ = v{t,x), where 
V has been defined in ()3.5p and it is also the solution of the related Hamilton-Jacobi-Bellman 
equation. This fact will be crucial in order to study the convergence of (1^", Z'^) as n — )• +oo. 
In the probability space (fi, J-", P), we denote by X^ the solution of equation (I3.22p . then 

E sup |X""-X"|''<E sup I / e(*-')^7Q('u, -n)l|„^|>„(is 
te[o,T] ie[o,T] Jo 

<C{T,A,Q)E [ \us - n\n\^^\^^ds 
Jo 



and so X" — t- X" in L'^($7, C([0,T],/7)), with probability measure P. By combining this fact 
with the previous arguments on the the dt x P- almost sure convergence of u" we get that 
X" — )■ X" P-almost surely uniformly with respect to t. 
Moreover (y^"-*-^^ ^^"'*'^) = {v{t,x),V^v{t,x), and for ah r G [t,T], 

(Yf''^,Zf^^) = {v{T,Xf'''^),V'^v{T,Xf '*''') (3.33) 



18 



and since we work with lipschitz continuous assumptions on the final cost (j) and Gateaux dif- 
ferentiabihty assumptions on if) by theorem 13.31 we get that both v and SI^^v are bounded 
and continuous. In the probabihty space (Q, J^, P), by using the pointwise convergence, of X" 
to X", uniformly with respect to time, we deduce a pointwise convergence uniform in time 
of (y",Z"), passing through the identification (|3.33|) of Y^ and Z". Namely, in (J7,J^, P), 
^Yn,t,x^^n,t,x^ = (t;(r,xf •*'"), Vv^?;(T,Xr'*'")) ^ (7;(t,X*'"),Vv^?;(t,X*'")) P-almost surely 
uniformly with respect to r. 

Now we are ready to prove the fundamental relation: we integrate the BSDE (j3.32p in [t, T]: 
at first we write down the equation with rspect to the P^-Wiener process W^ and then we pass 
to the process W , which is a standard Wiener process in the original probability space ($7, J^, P): 



dYr = HXf)+f ^{Z^)ds+j l{Xf)ds-l Z^dW^ 
Jt Jt Jt 

f-T f-T f-T i-T 

= 4>{Xf) + / V(^r) ds+ l{Xf) ds- R{u^^)ds - / Z," dWs 



We notice that by standard arguments since Z" G L^(($7, J^, P") x [0,T]), then it also holds that 
Z" G L^((ri,J^, P) X [0,T]). Now we integrate with respect to the original probability P: by 
taking expectation in the previous integral equality 

/•T f-T f-T 

dYl" = W.<j){Xf ) + E / 'il;{Z^)ds + E l{X''"s) ds-K Z^ dW^ 
Jt Jt Jt 

f-T f-T f-T f-T 

= K4>{Xf) + E / V(^s") ds + E l{Xf) ds-E Z^R{u'^)ds - E / Z^ dWs 
Jt Jt Jt Jt 

rp IT T' 

= E(t>{Xf)+E [ il:{V^v{s,Xf))ds + Ef l{Xf)ds-E[ V^v{s,Xf)R{u'^)ds 
Jt Jt Jt 

where in the last passage the stochastic integral has zero expectation, and we have identified Z" 
with \/^v{s,X'^"). Next we also identify Y^ with v(t,x) and then we let n — )• +00: 

v{t,x)=E(l){Xf) + Ef tP{V'^v{s,Xf))ds + E [ l{Xf)ds-E[ V'^v{s,Xf)R{u'l)ds 

Jt Jt Jt 

-^ E0(X^) + E / V(V^i;(s, X,")) ds + E [ 1{X^) ds-E f V^v{s, X^)R{us)ds. 
Jt Jt Jt 



rp 

By adding and subtracting E J^ g{us)ds we get 



It 



J{t,x,u) = v{t,x)+E f -ij{V^v{s,X^))+V^v{s,X^)R{us) + gius) ds, (3.34) 

from which we deduce the desired conclusion. D 

Under the assumptions of Theorem 13. 17^ let us define the so called optimal feedback law: 



u{s,x) =7(v^v(s,X,"'*'^)j, s£[t,T], x£H. (3.35) 

Assume that the closed loop equation admits a solution {Xg, s G [^,2^]}: 
X, = e(^-*)^xo + r e^'-'^'^^/QdWr + I" e^'-'^^R{-/{V'^v{s,Xr)))dr, s G [t,T]. (3.36) 
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Then the pair (u = u{s,Xs),X)g^u^x] is optimal for the coNntrol problem. We nevertheless 
notice that existence of a solution of the closed loop equation is not obvious, due to the lack of 
regularity of the feedback law u occurring in (j3.36p . This problem can be avoided by formulating 
the optimal control problem in the weak sense, following [9j, see also [12j and [17J . 
By an admissible control system we mean 

where W is an if- valued Wiener process, u is an admissible control and X" solves the controlled 
equation (j3.22p . The control problem in weak formulation is to minimize the cost functional 
over all the admissible control systems. 

Theorem 3.18 Assum,e hypotheses \2.1[ \2.^ \3.12\ and \3.13\ hold true, and assume that the 
hamiltonian function ip satisfies Gateaux differentiability assumptions stated in hypothesis 13. JL 
For every t G [0, T], x £ H and for all admissible control systems we have J{t,x,u{-)) > v{t,x), 
and the equality holds if and only if 

Us£T(v^vis,X^) 

Moreover assume that the set-valued map T is non empty and let 7 be its measurable selection. 

Ur = -i{V^v{T,X:^)), ¥-a.s. for a.a. r G [t,T] 

is optimal. 

Finally, the closed loop equation 

I dX^ 

I xr = x. 



AX'- + ^R (7(Vv^«(t, Xm)\ dr + VQdW^, r G [t, T] ^^^^^^ 



1 ^^T I I 1 



admits a weak solution (f^,-F, {J^t)t>o j^P^;^)^) which is unique in law and setting 

Ur=-f(y'^v(T,X^ 

we obtain an optimal admissible control system (W, u, X) . 

Proof. The proof follows from the fundamental relation stated in theorem 13.171 The only 
difference here is the solvability of the closed loop equation in the weak sense: this is a standard 
application of the Girsanov theorem. Indeed, by lemma [3. 151 the infimum in the hamiltonian is 
achieved in a ball of radius C(l + |z|^~^) and so for the optimal control u the following estimate 
holds true, P-a.s. and for a.a. t £ [t,T], < t < T: 

\ur\ < C{1 + |Z*'^|P-i) = C(l + |V^v(r,X*'^|P-i) < C. 

Thanks to this bound we can apply a Girsanov change of measure and the conclusion follows in 
a standard way. D 
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4 The semilinear Komogorov equation in the quadratic case: 
continuous final condition 

Let V be the mild solution of the semilinear Kolmogororv equation 13. 1|, with the nonlinear term 
which is quadratic with respect to the \/Q-derivative and with final condition (p differentiable. 
The aim of this section is to present an estimate for the -y/Q-derivative of u{t, x) depending 
on T, t, \\4>\\oci but not on the Vt/). If X is finite dimensional, also for processes more general 
than the Onstein uhlenbeck process, this estimate has been obtained in [22] by imposing some 
conditions on the coefficient of the forward equation for X. With those conditions, by inverting 
'VX and by techniques coming from BMO martingales, the estimate is proved. Also in [2J a 
similar estimate is proved with X finite dimensional, with a more restrictive structure than in 
[22] but with ip also with super quadratic growth. Applications of this estimate to a related 
Kolmogorov equation are not exploited in [2j nor in j22j . 

Here we prove the estimate for V^'^v when X is an infinite dimensional Ornstein Uhlenbeck 
process and A and Q commute. We apply this estimate to prove that there exists a mild solution 
of the semilinear Kolmogorov equation (13. ip with the nonlinear term which is quadratic with 
respect to the -v/Q-derivative. Also in the finite dimensional case, in the setting of |2] and of 
[22j . solution of the related Kolmogorov equation can be achieved with our techniques. 

Assume that A and \/Q commute and that v is the unique mild solution of equation (j3.ip 



As already noticed, if (p and ^p are Gateaux differentiable, then v is given by v{t, x) = Y^'^ 
where (1^' , Zr )T-£[t,T] solve the BSDE in the forward-backward system (|3.3p with I = 0, that 
we rewrite here: 

dXr = AXrdT + y^dWr, T £ [t, T] C [0, T] , 

^t = X, , . 

dYr = -Tp{Zr) dT + Zr dWr, ^ ' 

YT = cP{x'f). 

Moreover, by [15], see also p], when ip is quadratic in Z it turns out that (<l*(r) = J^ ZsdWs)re[t,T] 
is a BMO martingale and 



I^IIbmo = sup E 



Zj g UuS\j (J 



1/2 



< +00, 



where the supremum is taken over all stopping times a G [t, T\ a.s. Moreover, as a consequence, 
the stochastic exponential martingale 



E{^)r =Er = exp U ZsdWs -\r Z'^ds) 



is uniformly integrable. We are ready to prove an estimate on Z, independent on V(^. 

Theorem 4.1 Let (Y, Z) he the solution of the BSDE in |^. jp . Let A and \fQ satisfy hypothesis 
\2.1\ and assume that A and \/Q commute. Let (p and ip satisfy hupotheses \3.1\ and \3.2\ with p = 2. 
Then the folllowing estimate holds true: 

\zl^^\<C{T-t)-^l'^, (4.2) 

where C depends on t, T, A, \\(p\\oo and not on Vcp. 

Proof. Let us take the -v/Q-derivative in the BSDE in (14. ip in the direction h €z H. Let us 
denote Fr''' = V^Yr'^'h and Vr''' = Vv^Z*'^'/i. (F, V) solve the fohowing BSDE 

dF^.^ = -ViPiZi'^)V^'^ dr + T/*'^ dWr, 
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Let us denote by Q the equivalent probability measure such that 

dW^ ■■=- f i){Zl^'')ds + Wr 
Jo 

is a Wiener process. Notice that by our assumptions Vip has linear growth with respect to Z, 

so ( r Vijj(Zt''')dWs) is a BMO martingale and 

V '^ y Telt,T] 



£r = e^v(yj\{ZinWs-\^^ 

dF 
is a uniformly integrable martingale. Notice that — — = £t- 

In (J], J",Q), (F*'^,1/*'^) solve the following BSDE: 

^pt^,X ^ yt,X ^^Q^ 

It turns out that (F*'^)^ is a Q-submartingale. 

In (f^, J",Q), (y*'^,Z*'^) solve the following BSDE: 

rt,X 



fZf'^lPds 



(4.4) 



^Y^,x ^ _^{^zi^^)dT + VV'(4'"=)4''^ dT + z;^ 



t,x 



^T h 



and by our assumptions the generator —ip{Zr ) + Vip{Zr )Zr has quadratic growth with 
respect to Z, so again by |15] {f^ Zs'^ds,T £ [t,T]) is a BMO Q-martingale, with BMO norm 



depending only on T, t, A and nv^noo- 

Moreover let us denote again Y^ '^ = v{t,x). Since A and Q commute, 

F^.- :=< VviT,Xin,VQh >=< Vxvir,Xi^^),e^-~'^^^/Qh > 
With these facts we can prove the desired estimate, indeed, since (i^*'^)^ ig a Q-submartingale 



Moreover 



E^ 



Ut 



?t,x\2. 



J \F'/'fds\J^t 



t,Xr\2f 



> {F^'^'l^iT - t) = {Zl'^'hl^iT - t 



iF^'^rdslJ-i 



E^ 






< w 



BMO,Q^ 



where Ct^r depends only on T, t, A. So 

|Z*'^| <C{T-t)-^/^, 
where C depends on t, T, A, \\(j)\\oo and not on Vcp. 



D 



Remark 4.2 Notice that under the assumptions of theorem \4-l\ Z^^ = V^'^f(i,x), where 
v{t,x) = Y^'^ is the unique mild solution of equation \3.1[ So estimate ^.2\ ) gives a bound 
of V^v in C^ ([0, T] x H, H*), with a = 1/2. 
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Next we want to apply the result of theorem 14.11 to find a mild solution to equation I3.1i 

Theorem 4.3 Let A and \fQ satisfy hypothesis \ 2. 1\ and assume that A and \fQ commute. Let 
(j) and ip satisfy hypotheses \3.1[ Then equation \3. J|) admits a unique mild solution v according 
to definition \3.1[ 



Proof. Let (p G UCb (H). We can define, see e.g. [8] and [T^, the inf-sup convolutions (f)n of (f) 
by setting, for n > 1, 

^nix)= ml\^{y) + 2n\x-y\l}, (4.5) 

It is well known that the inf-sup convolution </>„ of (j) provides an approximation of (p in the norm 
of the uniform convergence, preseving the supremum norm, and for every n, (/>„ is lipschitz 
continuous and Frechet differentiable, with derivative blowing up like n as n — )• +oo. So for 
every n equation 

f ^(i,x) = -£n(t,x)+v(vv^n(t,x))+/(x), tG[0,T],xGF 

[ u{T, x) = (f>n (x) , 

admits a unique mild solution Vn according to definition [3TTJ Notice that Vn(t, x) = Y"''^'^, where 
we denote by (X*'^,y"'*'^, Z"'*'^) the unique solution of a forward backward system like ()3.3p 
with final condition <j) replaced by 4>n- It is immediate to see from the backward equation that 

Kt - J^ I < C\\(pn -(pfclloo 

Indeed, let us consider the BSDE solved by y"'*'^' — y^:*.^ 

Let us denote by Q"''^ the equivalent probability measure such that 

is a Wiener process. Writing equation 14.71 in (^2, J^, Q"''^) we get the desired estimate. Notice 
that by our assumptions 

I / ryn,t,X\ I / ryk,t,X\ 

n,t,x _ ^k,t,x^ X|^n,t,._^fc,t,._^g| S 0(i + |X^ \ + \^s \) 

so, 






" V;(Zr'^'") - V^(Z. 



is a BMO martingale and 



n,t,X\ I j ryk,t,X\ 
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r/lP 
is a uniformly integrable martingale, with ^^^ ^^ = f^' . By previous arguments we know that 



IK 



n,k 
n,t,x 'trk,t,x 



K"1 < cuWc 



uniformly in n and k. Next we have to prove that 



\Z, 



n,t,X r7k,t,X 



Z^' '""l < C\\(j)n - 0fc| 



We differentiate equation (j4.7p . rewritten in (il, J^, Q"'*^), in the direction y/Qh^ h ^ H. We get 

^^pn,t,x _ pk,t,X^ ^ ^yn,t,x _ yk,t,X^ ^^^^ 

(4.8) 



j,n,t,x _ pk,t,x ^ (v^"(x^^') _ V0"(X^^))e(^-*)^yQ/i, 
So, in ((7, J-,Q"'^'), If"'*-'' - Fr'*'^,T G [t,T]| is a martingale: 



Moreover 



^n,t,x Tpk,t,x\2 



Ff'^'^rdsij; 



>\E 



ri,t,x jpk,t,x\2 



n,t,x r^k,t,x\i\2 



(T-t) = |(z;"'''^-z, 



{T-t). 



K 



'f\n,k 



Tin.t.x T7ik,t,x\2 



F^''^^\'ds\J^t 



E^ 



< Ct t'E^ 



/ I < Z,"'*'^ - Z^/^\ e^"'^^h > l^dsl j; 



7n,t,X ryk,t,X\2 



ds\Ft 



IJt 



where Ct^T is a bounded constant depending on t, T, A. Moreover in (il, J^, Q"'*^) by equation 
(14. 7|) we immediately get 



E^ 



\Z 



n,t,x 



z 



k,t,x\2 



ds\Ft 



< 



^fclloo 



-1/2 



and so 

where Ct^T is a bounded constant depending on t, T, ^4 and not on Vcj). 

So we get that by setting v'^{t,x) = Y^^{t,x), the solution of the Kolmogorov equation (|4.6p 
v'^{t,x) converges in C([0,T] x H) to v{t,x), equal to Y^'^. Moreover for every n, Z"' '^ = 
Vv^u"(t,x), and by 1^ (Vv^u"(t,x))„ is a Cauchy sequence in Cl^^{[0,T] x H)). So 

V^*5i'"'(t, x) converges in C^/2([0, T] x //)) to an element that we denote by F{t,x). For every 
n> 1, 

f"(t,x + S\/Q/i)-w"(t,a;) [^ 



V^v''{t,x + r^h)hdr. 



As n — >• +00 we get 



v{t,x + s^/Qh) — v{t,x) f^ 



F{t,x + r^/Qh)hdr. 



which gives F{t, x)h = \7^v{t, x)h. It remains to see that for every r G [0, T], V^w(r, Xr^)h = 
Zr^ , where Z*'^ is the limit of Z"'*'^ in L^(ri x [0, T]). It turns out that by previous calculations 
V^^?;"(r,X*'^) ^ Vv^i;(t,X*'^) in q/2([0,T] x H)). So Vv^7;(t,X*'^) 



7t,X 



a.s. for a. a. 



T G [t,r]. Since {Y,Z) solve the BSDE in (j4.ip . with 1^ '^ = v{t,x), by previous arguments we 
get Z^'^ = V^T;(t,x). By classical arguments we deduce that v solves equation (j3.ip . Moreover 
the solution is unique since the solution of the corresponding BSDE is unique. n 
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4.1 A quadratic optimal control problem 

We apply the result of the previous section to a control problem where the current cost has 

quadratic growth with respect to the control u and the final cost is only continuous. The 

fundamental relation and the existence of a solution of the closed loop equation cannot be 

achieved as in theorem 13.171 and 13.181 respectivelv. since this time Z^'^ = V^'^w(t,x) is not 

bounded. 

Let X" the solution of equation (|3.22p , and we have to minimize the cost functional (j3.23p 

over all the admissible control n, where by admissible control we mean here an (J-t)i-predictable 

process, taking values in a closed subset i^ of a normed space C/, such that 

rT 
E / \us\ ds < +00. 



/o 

This assumptions is natural this time since we assume here that the cost has quadratic growth 
at infinity, namely the cost must satisfy hvpothesis 13.121 with q = 2. We define the hamiltonian 
function in a classical way as in 13.261 The hamiltonian satisfies the properties stated in lemma 
13.151 in particular estimates ()3.28p and ()3.27p hold true with p = 2 and the infimum is achieved 
in a ball of radius C(l + \z\). 

Theorem 4.4 Assume that A and ^/Q satisfy hvpothesis \ 2. 1\ and commute. Let g and I satisfy 
point 2 and 3 of hypothesis \3.12\ and let hypothesis \3.13\ hold true; assume that the hamiltonian 
function ip satisfies Gateaux differentiability assumptions stated in hypothesis \3.1[ For every 
t £ [0,r], X € H and for all admissible control u we have J{t,x,u{-)) > v{t,x), and the equality 
holds if and only if 

Us Grfv^t;(s,X,"'*'^) 



Proof. The proof follows from proposition 4.1 in [llj, and by our assumption here we have also 
the identification Zt^ = V^v{T,Xr''^). 

With the assumptions of Theorem 14.41 we can define the so called optimal feedback law as 
we have done in I3.35[ Since as we have already noticed in section 13.41 existence of a solution of 
the closed loop equation is not obvious, we formulate the optimal control problem in the weak 
sense, following [9], see also section [331 

Theorem 4.5 Assumehat A and \fQ satisfy hypothesis \2.1\ and commute. Let g and I satisfy 
point 2 and 3 of hypothesis \3.12\ and let hypothesis \3.13\ hold true; assume that the hamiltonian 
function ip satisfies Gateaux differentiability assumptions stated in hypothesis \3.1[ For every 
t £ [0,T], X G H and for all admissible control systems we have J{t,x,u{-)) > v{t,x), and the 
equality holds if and only if 

UsGt(v^v{s,X^)) 

Moreover assume that the set-valued map T and let 7 be its measurable selection. 

Ur = 7(V^u(r,X;')), ¥-a.s. for a.a. r G [t,T] 

is optimal. 



Finally, the closed loop equation 3.37 admits a weak solution {Q,T,{J-t)fyQ ,f,W,X) which 
is unique in law and setting 



we obtain an optimal admissible control system (W, u, X) . 

Proof. The proof follows from the fundamental relation stated in theorem 14.41 For the solv- 
ability of the closed loop equation we refer to proposition 5.2 in [TT]. D 
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5 Optimal control problems for the heat equation 

In this section we present some control problem related to a stochastic heat equation. As in 
section [21 when introducing equation (j2.6p . here O is a bounded domain in M, i7 = L^(0) 
and {e/c}^gj^ is the complete orthonormal basis which diagonalizes A, endowed with Dirirchlet 
boundary conditions in O. Q : H ^ H satisfies hypothesis 12.31 in particular Qck = Xk^k, ^k > 
0, fc S N. We consider the following controlled heat equation 



^(5,0 = Ay(s,0 + + Y.^/X'k UuMek(.v)dv] ekiO + ^(^^0, s G [t,T], ^ G O, 

(5.1) 
where Ug G Lp'{0) represents the control. In the following we denote by Ad the set of admissible 
controls, that is the real valued predictable processes such that 



^ [ ([ \MO\^dn dt <+oo. 



and such that ut £ K, where i^ is a closed subset of H, not necessarily coinciding with H. Here 
as in equation (j2.6p . W^{s,^) is a Gaussian mean zero random field, such that the operator Q 
characterizes the correlation in the space variables. Our aim is to minimize over all admissible 
controls the cost functional 

j(t,x(o,^) = E / f[i{x:io) + \u,iondcds+K f 4>{x'm) ^e (5.2) 

Jt Jo Jo 

for real functions (j) and /, and for q <2. 

We make the following assumptions on the cost J. 

Hypothesis 5.1 The function </> : M — )• M zs lipschitz continuous and bounded; / : M — )• M is 
bounded and continuous. 

Let us define, foic^GH 

cPix) = f ^{x{0) d^, l{x) = f lixiO) dC- (5.3) 

Jo Jo 

It turns out that if / and (j) satisfy hypothesis 15. H then cp and / defined in ()5.3p satisfy hypothesis 
13.121 Moreover by defining g{u) = J^ \usiO\'^d^ = \u\i2(^q^, then the hamiltonian function turns 

out to be i/j{z) = {^)^^\z\P. 

Moreover equation ()5.ip can be written in an abstract way in H as 

dXr = AXrdT + ,/QUr + VQdWr, T E [t, T] 

Xt = X, ^^■^> 

where A is the Laplace operator with Dirirchlet boundary conditions, T^ is a cylindrical Wiener 
process in H and Q is its covariance operator. The control problem in its abstract formulation 
is to minimize over all admissible controls the cost functional 

J(t,x,u)=E/" [l{X^) + \us\'^]ds + E(l){X^). (5.5) 

By applying results in section 13.41 we get the following 
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Theorem 5.2 Let X" be the solution of equation i5.1\) . let the cost be defined as in i5.2\) and let 
5.1\ hold true. Moreover assume that the hamiltonian function ip satisfies Gateaux differentiability 
assumptions stated in hypothesis \3.1[ For every t E [0, T], x G Lp'{0) and for all admissible 
control u we have J{t,x,u{-)) > v{t,x), and the equality holds if and only if 



Moreover assume that the set-valued map T is nonempty and let 7 

The closed loop equation admits a weak solution {i^,J-, (/"f)j>Q ,¥,W,X) which is unique in 
law and setting 

Ur = -r(v^v{T,Xr 



we obtain an optimal admissible control system (W, u, X) . 

Proof. The proof foUows from the abstract formulation of the problem, and by applying theo- 
rems |3l7] and [3T8l D 



Next we turn to an optimal control problem related to the controlled equation ()5.4p with 
quadratic cost g and consequently quadratic hamiltonian function, and with final cost continu- 
ous. In this case, in order to perform the synthesis of the optimal control, we apply the results 
of section 14.11 Namely we consider equation (|5.ip . We have to minimize the cost functional 



rT 



J{t,x{C,u)=K f f [l{XfiO)+g{us{Omds + E f ^{XUO) dC. (5.6) 

Jt Jo Jo 

over all admissible controls, that is real valued predictable processes such that 

rT 



^ [ ([ \MO\^dndt<+oo. 



(j), g and / are real functions satisfying the following: 

Hypothesis 5.3 The function (^ : M — )• M is continuous and bounded; / : M — )• M is bounded and 
continuous; 5 : M — >• M is continuous and for every n G M 

0<g{u) <c(l + |n|2) 

and there exist R > 0, C > such that 

g{u) > C\u\ for every u £ K : \u\ > R. 

Equation (15. ip admits the abstract formulation given by (15. 4p and the cost functional can be 
formulated in an abstract way as 

J{t,x,u)=E f I (X^) + gius)ds + E0 (X^) . 
with notation 15.31 and by setting moreover 



g{u)= / 5K0)^^, • 
Jo 

It turns out that if (p, I and g satisfy hvpothesis l5.3| then cj), I and g satisfy hvpothesis 13.121 with 
q = 2. 
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Theorem 5.4 Let X" be the solution of equation i5.1\} . let the cost be defined as in \5.6\ and let 
5. 31 hold true. Moreover assume that the hamiltonian function ip satisfies Gateaux differentiability 
assumptions stated in hupothesis \3.1[ For every t e [0, T], x G L^(C') and for all admissible 
control u we have J{t,x,u{-)) > v{t,x), and the equality holds if and only if 



Moreover assume that the set-valued map T is nonempty and let 7 be its measurable selection. 
The closed loop equation admits a weak solution {0,,J^, (Tt)t>o ^^^^^-^) which is unique in law 
and setting 



we obtain an optimal admissible control system (W, u, X) . 

Proof. The proof follows from the abstract formulation of the problem, and by applying theorem 
IH □ 
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